MIT OpenCourseWare 
http://ocw.mit.edu 



18.102 Introduction to Functional Analysis 

Spring 2009 



For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms . 



8 



LECTURE NOTES FOR 18.102, SPRING 2009 



Lecture 3. Tuesday, 10 Feb. 

Recalled the proof from last time that the bounded operators from a normed 
space into a Banach space form a Banach space - mainly to suggest that it is not 
so hard to remember how such a proof goes. Then proved that a normed space is 
Banach iff every 'absolutely summable' series is convergent. Absolute summability 
means that the sum of the norms is finite. Then did most of the proof that every 
normed space can be completed to a Banach space using this notion of absolutely 
summable sequences. The last part - and a guide to how to attempt the part of 
the proof that is the first question on the next homework. The proof of the result 
about completeness from the early part of the leture is in 

(1) Wilde:- Proposition 1.6 

(2) Chen:- I didn't find it. 

(3) Ward:- Lemma 2.1 (easy way only) 

Here is a slightly abbreviated version of what I did in lecture today on the 
completion of a normed space. The very last part I asked you to finish as the first 
part of the second problem set, not due until February 24 due to the vagaries of the 
MIT calendar (but up later today). This problem may seem rather heavy sledding 
but if you can work through it all you will understand, before we get to it, the 
main sorts of arguments needed to prove most of the integrability results we will 
encounter later. 

Let V be a normed space with norm || • \\v- A completion of V is a Banach space 
B with the following properties :- 

(1) There is an injective (1-1) linear map / : V — ► B 

(2) The norms satisfy 

(3.1) ||/(tO||u = HvVt;eV. 

(3) The range I(V) cBis dense in B. 

Notice that if V is itself a Banach space then we can take B = V with / the 
identity map. 

So, the main result is: 

Theorem 1. Each normed space has a completion. 

'Proof (the last bit is left to you). First we introduce the rather large space 

(3.2) V= ^{u k }f =1 ;u k eV and £lKH < ^} 

the elements of which I called the absolutely summable series in V. 

Now, I showed in the earlier result that each element of V is a Cauchy sequence 

N 

meaning the corresponding sequence of partial sums vn = ^2 u k is Cauchy if 

fc=i 

{u k } is absolutely summable. Now V is a linear space, where we add sequences, 
and multiply by constants, by doing the operations on each component :- 

(3.3) hiuk} + t 2 {u' k } = {t 1 u k + t 2 u / k }. 

This always gives an absolutely summable series by the triangle inequality: 

(3.4) ]T \\t lUk + t 2U ' k \\ <\ tl \J2 Nil + N £ |K||. 

k k k 
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Within V consider the linear subspace 

(3.5) s=U«*};£ \\u k \\ < oo, u k = \ 

I k k ) 

of those which converge to 0. As always for a linear subspace of a linear space we 
can form the quotient 

(3.6) B = V/S 

the elements of which are the 'cosets' of the form {u k } + S C V where {uk} G V. 
We proceed to check the following properties of this B. 

(1) A norm on B is defined by 

n 

(3.7) ||6|| B = lim || V« fc ||, {u k }eb. 

n— >oo *• — ' 

k=l 

(2) The original space V is imbedded in B by 

(3.8) V 3 v i — ► I(v) = {u k } + S, u 1 = v, u k = V k> 1 

and the norm satisfies (3.1). 

(3) I{V) C B is dense. 

(4) B is a Banach space with the norm (3.7). 

So, first that (3.7) is a norm. The limit on the right does exist since the limit 
of the norm of a Cauchy sequence always exists - namely the sequence of norms 
is itself Cauchy but now in R. Moreover, adding an element of S to {u k } does not 
change the norm of the sequence of partial sums, since the addtional term tends 
to zero in norm. Thus is well-defined for each element b e B and ||6||b = 

means exactly that the sequence {u k } used to define it tends to in norm, hence 
is in S hence b — 0. The other two properties of norm are reasonably clear, since 
if b, b' <G B are represented by {u k }, {u' k } in V then tb and b+b' are reprented by 
{tu k } and {u k + u' k } and 

n n 

lim ||Vt Ufc || = |£| lim llVufeU, 

n— >-oo z — » n— >oo z — * 

k=l k=l 

n 

lim \\^2(u k + u' k )\\ =A=> 

k=l 

n 

(3.9) for e > 3 N s.t. V n > N, A — e<\\ ^(u fe + u' k )\\ =^ 

k=i 

n n 

A-e<\\J2^k\\ + \\J2 u/ k)W^ n > N ^ 

k=l k=l 

A-e< ||&||b + ||&'||b Ve>0=> 

\\b + b'\\ B < ||6|| b + ||6'||b. 

Now the norm of the element I(v) = v, 0, 0, • • • , is the limit of the norms of the 
sequence of partial sums and hence is \\v\\v so = \\v\\v an d I(v) = 

therefore implies v — and hence / is also injective. 

So, we need to check that B is complete, and also that I(V) is dense. Here is 
an extended discussion of the difficulty - of course maybe you can see it directly 



10 



LECTURE NOTES FOR 18.102, SPRING 2009 



yourself (or have a better scheme). Note that I want you to write out your own 
version of it carefully for the next problem set. 

Okay what does it mean for B to be a Banach space, well as we saw in class 
today it means that every absolutely summable series in B is convergent. Such a 
series {b n } is given by b n — {u k n ^} + S where {u^} G V and the summability 
condition is that 

(3.10) oo>EllM*=E lim llf>i n) lk- 

n n k—1 

So, we want to show that ~^2b n = b converges, and to do so we need to find the 

n 

limit b. It is supposed to be given by an absolutely summable scries. The 'problem' 
is that this series should look like ^ ^ in some sense - because it is supposed 

n k 

to represent the sum of the 6„'s. Now, it would be very nice if we had the estimate 
(3.H) EEll«f ) llv<oo 

n k 

since this should allow us to break up the double sum in some nice way so as to get 
an absolutely summable series out of the whole thing. The trouble is that (3.11) 
need not hold. We know that each of the sums over k - for given n - converges, 
but not the sum of the sums. All we know here is that the sum of the 'limits of the 
norms' in (3.10) converges. 

So, that is the problem! One way to see the solution is to note that we do not 
have to choose the original {u k n ^} to 'represent' b n - we can add to it any element 
of 5*. One idea is to rearrange the u^jf 1 - I am thinking here of fixed n - so that it 
'converges even faster.' Given e > we can choose N\ so that for all N > N\, 

(3.12) iiiE^IIv-HMbI^, Eii4"V< £ - 

k<N k>N 

Then in fact we can choose successive Nj < Nj_i (remember that little n is fixed 
here) so that 

(3.13) HI E "j^llv - IIMul < 2" j e, E ll«L n) llv < 2"^. 

k<N 3 k>N 3 

Now, 'resum the series' defining instead v[ n ^ = — an( i do 

k=l fe=JVj_i 

this setting e = 2~" for the nth series. Check that now 
(3-14) EEll4 n) lk<-- 

n k 

Of course, you should also check that b n = {v^} + S so that these new summable 
series work just as well as the old ones. 

After this fiddling you can now try to find a limit for the sequence as 

(3.15) b = {w k } + S, w k = E v l P) e V. 

l+p=k 

So, you need to check that this {wk} is absolutely summable in V and that b n b 
as n — > oo. 

I may add some more to discussion of completeness if needed. 
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Finally then there is the question of showing that I(V) is dense in B. You can do 
this using the same idea as above - in fact it might be better to do it first. Given 
an element ieBwe need to find elements in V, Vk such that ||/(wfe) — — > as 

k — > oo. Take an absolutely summable series Uk representing b and take Vj = ^ Uk 

fe=i 

where the N/s are constructed as above and check that I(vj) — > b by computing 
(3.16) \\I( Vj ) -b\\ B = lim || u pWv < E KHv- 

□ 
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Problem set 2, Due 11AM Tuesday 24 Feb. 

I was originally going to make this problem set longer, since there is a missing 
Tuesday. However, I would prefer you to concentrate on getting all four of these 
questions really right! 

Problem 2.1 Finish the proof of the completeness of the space B constructed in 
lecture on February 10. The description of that construction can be found in the 
notes to Lecture 3 as well as an indication of one way to proceed. 

Problem 2.2 Let's consider an example of an absolutely summable sequence 
of step functions. For the interval [0,1) (remember there is a strong preference 
for left-closed but right-open intervals for the moment) consider a variant of the 
construction of the standard Cantor subset based on 3 proceeding in steps. Thus, 
remove the 'central interval [1/3,2/3). This leave d = [0,1/3) U [2/3,1). Then 
remove the central interval from each of the remaining two intervals to get C2 = 
[0, 1/9) U [2/9, 1/3) U [2/3, 7/9) U [8/9, 1). Carry on in this way to define successive 
sets Cfc C Ck—i, each consisting of a finite union of semi-open intervals. Now, 
consider the series of step functions fk where fk{x) = 1 on Ck and otherwise. 

(1) Check that this is an absolutely summable series. 

(2) For which x £ [0, 1) does ^2 \fk(x)\ converge? 

k 

(3) Describe a function on [0, 1) which is shown to be Lebesgue integrable 
(as defined in Lecture 4) by the existence of this series and compute its 
Lebesgue integral. 

(4) Is this function Riemann integrable (this is easy, not hard, if you check the 
definition of Riemann integrability)? 

(5) Finally consider the function g which is equal to one on the union of all the 
intervals which are removed in the construction and zero elsewhere. Show 
that g is Lebesgue integrable and compute its integral. 

Problem 2.3 The covering lemma for R 2 . By a rectangle we will mean a set of 
the form [ai, 61) x [02, 62) m R 2 - The area of a rectangle is (61 — a\) x (6 2 — 02)- 

(1) We may subdivide a rectangle by subdividing either of the intervals - re- 
placing [ai,&i) by [a\,C\) U [ci,6i). Show that the sum of the areas of 
rectangles made by any repeated subdivision is always the same as that of 
the original. 

(2) Suppose that a finite collection of disjoint rectangles has union a rectangle 
(always in this same half-open sense). Show, and I really mean prove, that 
the sum of the areas is the area of the whole rectange. Hint:- proceed by 
subdivision. 

(3) Now show that for any countable collection of disjoint rectangles contained 
in a given rectange the sum of the areas is less than or equal to that of the 
containing rectangle. 

(4) Show that if a finite collection of rectangles has union containing a given 
rectange then the sum of the areas of the rectangles is at least as large of 
that of the rectangle contained in the union. 

(5) Prove the extension of the preceeding result to a countable collection of 
rectangles with union containing a given rectangle. 

Problem 2.4 
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(1) Show that any continuous function on [0, 1] is the uniform limit on [0, 1) 
of a sequence of step functions. Hint:- Reduce to the real case, divide the 
interval into 2" equal pieces and define the step functions to take infimim 
of the continuous function on the corresponding interval. Then use uniform 
convergence. 

(2) By using the 'telescoping trick' show that any continuous function on [0, 1) 
can be written as the sum 



where the fj are step functions and \fj( x )\ < 00 f° r a ^ x •= Pi !)• 

3 

(3) Conclude that any continuous function on [0, 1], extended to be outside 
this interval, is a Lebesgue integrable function on K. 



17) 
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Solutions to Problem set 1 

Full marks will be given to anyone who makes a good faith attempt to answer 
each question. The first four problems concern the 'little L p' spaces l p . Note that 
you have the choice of doing everything for p = 2 or for all 1 < p < oo. 

Everyone who handed in a script received full marks. 

Problem 1.1 Write out a proof (you can steal it from one of many places but at 
least write it out in your own hand) either for p = 2 or for each p with 1 < p < oo 
that 

oo 

P = {a : N — ► C; ^ K T < oo, aj = a(j)} 

3=1 



is a normed space with the norm 



This means writing out the proof that this is a linear space and that the three 
conditions required of a norm hold. 

Solution:- We know that the functions from any set with values in a linear space 
form a linear space - under addition of values (don't feel bad if you wrote this out, 
it is a good thing to do once). So, to see that V is a linear space it suffices to see 
that it is closed under addition and scalar multiplication. For scalar multiples this 
is clear:- 

(3.18) | taj| = |*||<Zi| so \\ta\\ p = \t\\\a\\ p 

which is part of what is needed for the proof that || • || p is a norm anyway. The fact 
that a, b e V implcs a + b E V follows once we show the triangle inequality or we 
can be a little cruder and observe that 

lot + h\ p < (2max(|o| i) \h\)) p = 2*max(|<, \h\ p ) < 2"(|oi| + \h\) 
( 3 - 19 ) h + br p = J2 K + h\ p < 2 p (\\a\\ p + \\b\\ p ), 

3 

where we use the fact that t p is an increasing function of t > 0. 

Now, to see that V is a normed space we need to check that ||a|| p is indeed a 
norm. It is non-negative and ||a|j p = implies ai — for all i which is to say a = 0. 
So, only the triangle inequality remains. For p = 1 this is a direct consequence of 
the usual triangle inequality: 

(3.20) \\a + olU = £ K + h\ < £(M + N) = Had! + 11%. 

i i 

For 1 < p < oo it is known as Minkowski's inequality This in turn is deduced 
from Holder's inequality - which follows from Young's inequality! The latter says 
if 1/p + 1/q = 1, so q = p/(p — 1), then 

(3.21) a/3 < — + — V a, j3 > 0. 

p q 

To check it, observe that as a function of a = x, 

(3.22) /(x) = __ x/3+ ^ 

p q 
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if non-negative at x = and clearly positive when x » 0, since x p grows faster 
than x(3. Moreover, it is differentiable and the derivative only vanishes at x 9 ^ 1 = 
(3, where it must have a global minimum in x > 0. At this point f(x) — so 
Young's inequality follows. Now, applying this with a — |a»|/||o|| p and (3 — \bi 
(assuming both are non-zero) and summing over i gives Holder's inequality 



l p , \h\ q 
<P \\b\\h 



= 1 



I £ oAl/llay&H, < £ klN/NWHI* < E ( £ 

(3.23) 1 i 

=> | E a ^*l - IMUHIg- 

i 

Of course, if cither ||a|| p = or = this inequality holds anyway. 

Now, from this Minkowski's inequality follows. Namely from the ordinary trian- 
gle inequality and then Minkowski's inequality (with q power in the first factor) 

(3.24) E l a « + b *\ P = E l a * + ^l^'k + h\ 

i i 

< E \<h + h\^\ ai \ + Ek + kl^N 



< 



1/9 



gives after division by the first factor on the right 

(3.25) \\a + b\\ p < \\a\\ p + \\b\\ p . 

Thus, l p is indeed a normed space. 

I did not necessarily expect you to go through the proof of Young-H61dcr- 
Minkowksi, but I think you should do so at some point since I will not do it in 
class. 

Problem 1.2 The 'tricky' part in Problem 1.1 is the triangle inequality Suppose 
you knew meaning I tell you - that for each N 



is a norm on C N 



would that help? 

Solution:- Yes indeed it helps. If we know that for each N 









1 








P 




)'«! 


'£") 


1 +1 













(3.26) 

then for elements of V the norms always bounds the right side from above, meaning 




N 

(3.27) IEK- + M P I <NIp + 



Since the left side is increasing with N it must converge and be bounded by the 
right, which is independent of N. That is, the triangle inequality follows. Really 
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this just means it is enough to go through the discussion in the first problem for 
finite, but arbitrary, N. 
Problem 1.3 

Prove directly that each V as defined in Problem 1.1 - or just I 2 - is complete, 
i.e. it is a Banach space. At the risk of offending some, let me say that this means 
showing that each Cauchy sequence converges. The problem here is to find the limit 
of a given Cauchy sequence. Show that for each N the sequence in obtained by 
truncating each of the elements at point N is Cauchy with respect to the norm in 
Problem 1.2 on C^. Show that this is the same as being Cauchy in in the usual 
sense (if you are doing p = 2 it is already the usual sense) and hence, this cut-off 
sequence converges. Use this to find a putative limit of the Cauchy sequence and 
then check that it works. 

Solution:- So, suppose we are given a Cauchy sequence in l p . Thus, each 
element is a sequence {a^}j2. 1 in P. From the continuity of the norm in Problem 
1.5 below, Ha^H must be Cauchy in K and so converges. In particular the sequence 
is norm bounded, there exists A such that ||a( n )|| p < A for all n. The Cauchy 
condition itself is that given e > there exists M such that for all m, n > M, 

(3.28) ||aW - a^\\ p = |aj"> - a< ro >|^ ' < e/2. 

Now for each i, |a-™' — a- m '| < \\a^ — a^ m '|| p so each of the sequences a\ n ^ must 
be Cauchy in C. Since C is complete 

(3.29) lim a\ n ^ = m exists for each i= 1,2, 

n^oo 

So, our putative limit is a, the sequence {dj}?^. The boundedness of the norms 
shows that 

N 

(3.30) J2\ a i n) \ P - AP 

i=l 

and we can pass to the limit here as n — > oo since there are only finitely many 
terms. Thus 

N 

(3.31) ^\a % \ p < A p V N=> \\a\\ p < A. 

i=l 

Thus, a € V as we hoped. Similarly, we can pass to the limit as m — > oo in the 
finite inequality which follows from the Cauchy conditions 

(3.32) ( ^| a («)_ a M n l <e/2 

i=l 

to see that for each N 

N 

(3.33) (Ei°i n) -°*n' ^ e / 2 

i=l 

and hence 

(3.34) \\a^ -a|| < e V n> M. 
Thus indeed, — > a in l p as we were trying to show. 
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Notice that the trick is to 'back off' to finite sums to avoid any issues of inter- 
changing limits. 
Problem 1.4 

Consider the 'unit sphere' in l p - where if you want you can set p — 2. This is 
the set of vectors of length 1 : 

S = {a e P] \\a\\ p = 1}. 

(1) Show that S is closed. 

(2) Recall the sequential (so not the open covering definition) characterization 
of compactness of a set in a metric space (e.g. by checking in Rudin). 

(3) Show that S is not compact by considering the sequence in l p with kth 
element the sequence which is all zeros except for a 1 in the fcth slot. Note 
that the main problem is not to get yourself confused about sequences of 
sequences! 

Solution:- By the next problem, the norm is continuous as a function, so 

(3.35) S = {a; \\a\\ = 1} 

is the inverse image of the closed subset {1}, hence closed. 

Now, the standard result on metric spaces is that a subset is compact if and only 
if every sequence with values in the subset has a convergent subsequence with limit 
in the subset (if you drop the last condition then the closure is compact). 

In this case we consider the sequence (of sequences) 

(3.36) (-) = (° 

II % = n 

This has the property that \\a^ — a( m )|| p = 2? whenever n ^ to. Thus, it cannot 
have any Cauchy subsequence, and hence cannot have a convergent subsequence, 
so S is not compact. 

This is important. In fact it is a major difference between finite-dimensional and 
infinite-dimensional normed spaces. In the latter case the unit sphere cannot be 
compact whereas in the former it is. 

Problem 1.5 Show that the norm on any normed space is continuous. 

Solution:- Right, so I should have put this problem earlier! 

The triangle inequality shows that for any ii,wina normed space 

(3.37) ||m|| < \\u — u|| + ||t>||, \\v\\ < \\u — v\\ + \\u\\ 
which implies that 

(3.38) HHI - IHH < t>||. 

This shows that || • || is continuous, indeed it is Lipschitz continuous. 



